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COMMUNICATING EVALUATfON RESULTS TO. THE PUBLIC: 
A FOUR i-TEP PROCESS 



A major problem facing all evaluators is non^tilifeation of results (cf . 

Patton, 1978; Haenn, 19'80)* A frequent factor in non-utilization of re-^u'ts 

^ . ... ^ 

is lack of communication or misconnnunication between evaluator and public. 

The purpose of this paper is to outline a procedure for communicating • 
evaluation results to various publics in an effort to achieve wider use of 
evaluation results* jThis paper, in its approach and authorship, represents 
combination of strategies from the evaluation specialist and the public 
relations specialist. 

This approach i,s depicted graphically below in Figure 1. 
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The* process consists of four steps. In' the first step we analyze. The ^ 
second .step is plan. In the planning phase, strategies for communicating with 

'• <'/. 

various individuals and groups are^mapped out. The third step is to 
conmunicate. This is the most obvious step and the one in which we actually 
present a message to a person or to a group of people. The fourth st^p is to 
evaluate. * In t^his stage, we determine whether or not, the analysis, planning, 
.and communication have been effective. What we want to know at this stage is 
whether or not the communicatidn achieved its intended purpose. Inasmuch as 
the evaluation feeds into the next round of analysis, the process is 
cyclical. We now turn our attention to a detailed discussion of. each of the 
four step.s. ' ' ^ ^ • ' ' . 

The first step of any communication requires th^t we analyze the 
perceptions of the people with whom we wish to communicate. ThisF^jitails 

I 

finding out what people already Know about the educational program of 
interest what their misconceptior\s might be, and where they have gotten 
informatioh about this program in the past. An excellent example of, an 
analysis of people' sTperceptions of public schools is^the annual Gallup Poll 
of education (cf. Gallup, September, 1981). 

According to a recent Gallup Poll .(19,^2^^ approximately one .adult in: three 
has, children enroHed in pulplic schools. The other two-thirds of the akult 
popiulation have no children enrdlled in public schools.. Furtheraore, there 
ate ^ome interesting differences bedw^en those adults who 'do have children 
enrolled in the public schools and thosfe who do not. 

In 19 79, approximately half of all adults who had children in school (49%) 
indicated that they believed that schools were doing a good job. Tliat is, 49% 
of the' adults surveyed .would give the school an **A" or "B"^ating. It must" be 

-2- 



pointed out here that the poll^sters did not provide criteria for B, C, D, E 
or F ratings. , Each responden^rVas free *to supply his or her own rating 

• ^ • ■ ' ' • . 

criteria. ^ * . ^ - 

Of the two-thirds of the adult population who had no chiWren in school, 
the number who gave public schools an "A" or "B" rdting was 29%. In 1981, '^30% 
of this group gave the, public schools an/'A" or VB" rating (however, only 46% 
of parents of public school children gave the schools an "A" o*r "B" rating). 

Among the group of adul4:s who had no children in school, 29% expressed ihe 
belief that schools have gotten worse in some way in the last ten ye^ars. 
Although this question was not addressed in the 1980 o-r 1981 Gallup Polls, it 
may be, safe ^o assume, based on the relative stability of the overall rating 

question, ^hat an equivalent number of non-parents will continue to have this 

' • * ' . ' X ' ^ 

perception of the public a^ohools today. 

( 

The Gallup Poll is merely one example of analysis at; the national level. 
This approach is an extremely effective one and one that is^npt prohibitively 
costly 'or complex to use at the local level.. In fact, toany school districts 
currently employ a survey sirailaf' to that used in th| annual Gallup Poll of 
education. The questions ajre available as are dire(ct^^ns on how to select^ 
questipns and train interviewers (Gallup, 1981, p«46; Banach,. 1980) . 

The crucial aspect of analysis is that the information gathered in the. 

^ * * - 

analysis be gathered from a truly random sample of people. It is too often 
the c^se that program administrators and evaluators- rely on iniformation that 
is, too close and too b'ia^d to be of help in spotting points of dfeep publi?c^ 
conceriHr about tha^e programs* As noted previously, the methodology for 
select ingS^^^jggAining intetviewers and conducting the interviews is available 
and relatively inexpensive. In many instances, parents or volunteer groups 



have Been usejl* to' conduct the interviews. The actual numbers of resppnses 
• * 

required to achieve a sufficient leyel of precision it^ the survey are shown 



beldw in Tables 1 and 2. 
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Table 1 

^ Sample Sizes Needed to ^Detect Trends 
In Sur.vey Results-with + 5% Accuracy 
(95% Confidence Level) 



Proportion Giving a Particular Response 
Population ' ^OS or .95' 



Over 10,000 


75 


•-■-..10,000 


75 


5,000 


75 


4,000 , 


75 


3,000 


75 


- • 2,000 


75 


1,000 


70 


900 


70 


.800 


. 70 


700 


70 


- 600 


70 


500 


65 


400 


65 


300 


60 


' 200,- 


55 


100 


45 


50 









or .90 


.20 or .80' 


.30 OF ."^O 


.40 or .60 


150 


260 


315 


365 


140 " 


245 


315 


360 


135 


■ 235 


305 


345 


135 


235 


300 


, 340 


135 


230 


295 


, 330 


130 


220 


280 A 


315 


125 • 


- 200 


245 


270 . 


125 


195 


\. 240 


265' ■ 


120 . 


190. 


, 235' 


255 


120 


185 


■225 


245 


115 


175 


215 . 


' 230. 


110> ^ 


165 


- 200 


215 


105 


155 ' 


180 .„ 


■ 195 


95 


140 


160 


-• 170 


85 


115 


125 


130 


60 


75 . ' 


80 ■ 


80 


40 


45 


45 


45 



.50 



400 
370 
360 
355 
345 
325 
280 
270 
260 
250 
235 
220 
20p 
170 
135 
80 
45 



Table 2 



Maximum Sample Sizes Needed to Assure 95% Confidence 
In Survey Results With + y% Accuracy 

* . • Degree of Accdracy Required 



Exafn|t)le: 



\ PoDulation Size 
V TOpuiation 


+ 1% 


+ 2% 


+ P/0 


+ 10?^ 


Over 10,000 


\ 

10,000 


2500 


400 


100 * 


10,000 


^ 4900 t 


19 AO 


370 


100 


5,000 . 1 


^ 3290 


1625 


360 


95 


A, 000 


2835 


1505 


355 - 


^5 


^,UUu 


ooon 








■•2,000 


■ 1660 


1095 


325 


95 


1,000 


'■ 910 


710 


280 . 


90 


» 900 . 


■ . 825 


• 655 


270 


90 


^' 800 


: 7A0 


600 


260 


90 


700 


655 


5A5 


250 


85 


u600 : 


565 


A80 


235 


85 ' 


. 500 


- A80 


A15 


220 


85 


'400 ' 


385 


3A5 


200 


80 


300 


295 


270 


170 


'75 


* • ' 200 


200 


185 


135 


70 


100 


100 


; 100 


80 ^ 


50 


50 

f 


50 


50 


A5 


35 













YoA want to be able to interpret responses with + 5% accuracy. 
From a population of 3000 people, you select a sample of 345. On a 
particular issue, 47% of the people in the sample respond in a 
certain way. You can predict with 95^ confidence that between 42% 
and 52% of the people in the population would respond in that way 
on that issue. As tijie sample proportion departs from 50K, the 
confidence interval becomes even narrower. Thus, for example, if 
78% of the sample had responded in a certain way, you could predict 
with 95% confidence that between 73.9?i and 82.1% of the population 
would respoVid that way. 
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Table I represents the sample sizes n,ecessar^ to achieve »plus-or-minu3 5Z 

accuracy at the 95Z cdnildence level. This table is specifically' related to " * 

questions wl\ich will yield percentage type responses!- For example, if 

respondents are *asked the question "Do you tiiink our A^^^ools are doing a good j 

•job?" some will say yes, some. will say no, and some Will^be undecided. The 

expected percentages of any one of these catfi^gories will dictate to some 

extent the' size of the sample needed. If,* for example, 305t or 70Z of the. 

respondents are expected to give a particular response, and ^i-f the local, 

population is 5,000,^ then a sample si^e of 305 is. needed to achieve plu? or 

minus 5Z accuracy at the 9 5Z confidence ^evel. 

Table 2 assumes the c losest . possible split on any issue. As any issue 

* * f 

approaches a 50/50 split, the size of sample needed to assure accuracy 

increases. In'^ther words, t'n issue on which 80% of the gopulation gives the 

same answer is riot a very controversial issue. Therefore, a relatively small 

S4,mple size can detect fairly accurately what the population i^ercerjtage 

actually is. On the other hand*, where 50% of the pbpulation believes one 

thing'^nd 50%' believes anothW^ we "havTa" controversial issue on our hands.' ^ 

Where there is controversy, larger sample siz&s are needed to afesure' 

accuracy. Table 2 not only shows sample sizes needed for plus or minus five 

percent precision accuracy but for plus or minus 1%, plus or minus 2%, and 

plus or minus 10% precision. It should be noted that even with large sample 

sizes (anything over 10,000) a plus or minus 2% degree of prepision can be 

achieved with a sample size of .2,500. A degree of precisi,on of plus or minus 

5% can be achieved with a sample of 400 for populations of 10,000 or more. ' ' 

One criitical asp^t of selecting a sample size is to identify the 
Dotential users of the information you will be gathering. If this audience 
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doesn't approve of or understand the 'sample size or the sampling, procedures, 
* • » 

the results yill have nonimpact. Therefore, it is imperative that ^sample size 
be discussed with potential information users. 

Finally, there are three cruciaJL questions to addresa^ in the analysis. 
These are: * ' . ^ 

o What do they know? 

o 'What misconceptions exist?^ 

o Wh6re5idid they get "their information? 

Irl preparing to communicate with any audience or public, it is necessary 

I 

to find out what information has mrfeady been shared with that public. This, 
acti-vity encompasses the first and third questions shown above. It is 
necessary not only t6 find out what the public already knows about the 
particulajr educatipnaL program of interest but where they obtained this 
information as well. Was it from reliable sources? Was it from friendly or 
unfriendly sources? Was it from biased sources? 

This last question leads us to the issue^ of whether or not misconceptions 
exist. In working with Titljp I of the Eletnentary and Secondary Act of 1965, i 
continue to find th^t many people have seriou9 m^isconceptiojis about this 
program at the national, state, and local levels. T^iite frequently, non-T.itle 
I teachers and principals in buildings which are served with Title I funds 
have serious misconceptions about the identity of Title I. Any attempt to 
communicate evaluation results to individuals who have a basic misconception 
abou,t the nature of the program being evaluated is doomed to failure". 



Plan ' • 

i. " • p 

■r ^ A ' 

As information from the analysis becomes available, evaluators can move on 
,to the second step of the communication process. In this planning^tep, there 



are actually six cc^ponents to consider. Therfff* arej 1) public; 2)'message;- 
i) 'source; 4) channel; :0 reaction, and 6) feedback. Each of these components 
is described in some detail below. 

Public . In planning to present evaluation results, the first point which 
evaluatx)rfl must recognize is the fact- that* the public actually ^consists of 
severa Indifferent gijoups or individuals. These individuals and groups can be 
referred to as publics.. Each> public will be characteristically different from 
each other* public. The purposes for communicating with the various publics 
will also be quite diverse. ' * 

the first planning task, therefore, * is to determine exactly who ^ the 
various publids are. The^ analysis may have revealed, for example,^ that one 
public holds certain misconceptions about the program being considered, that 



^conceptions 
ttrong reelii 



'another group has very strong feelings about that same program, or that 
another group is a priority public because of their day-to-day contact with, 
that particular program. In practice, the number of*publics may be- quite 
large. ' * ' * 

^ For example, one might first divide publics into internal pulTlics a^nd 

external publics. Internal publics are those jindividuals or groups who have^ 

day-to-day contact with st<idents or programs. External publics, on the other' 

\ 

hand, are those individuals or groups who would hot have day-to-day contact 
with student or programs. Each of these groups ^an be further subdivided into 
smaller groups.^ For example, internal ^^blics might be divided* into .students, 
teachers, administrators, other school employees, and so on. Even one of 
these groups might be further subdivided into smaller groups. For example, 
the teacher group might well be divided into new teachers,* elementary grade 
teacher^, resource teachers, and a host of other teacher categories. The 
point is that each^of these specific publics differs from oth^r publics in 
ways that are rele^vent to the next five planning components. 



Message^ Each public will eventually receive a slight ly different 




message^ The basic message may well be the same for all publics. For^ 

example, the basic^message might well be that the program is effect!^ 
I ' ' ' ' * 

, However, because each of the publics has slightly different fuactiatis and 

information needs, the specific message whiqh ultimately re^che^ yBach ptiblic 

will be slightly different from the others. The fol'lowing example from 

Title I evaluation is offerred as illustration. //• 

don'sider three groups of individuals whom we will ideaji^fy as, JPublic A, 

. • . . Jf- 

Public B, and Public C. The concern of. Public A is the relationship between. 

Title I assistance and achievement in the riegular schooyJb program. From Che 

- ' /// 

general message that the program is effective, the spedxfic message for thi3 

. . '/(■: 

group might bie !*The children are showing marked imptoVement in reading and in 
Other areas." Public B has overall responsibility (Jor moving programs forward 



and is very responsive to information concerning ,^^)st scores. Therefore, the 

'J 'If 

specific message for this publ^ic might be "program cha^nges have led to better 

' ' : ' ' ' 

reading test scores." Finally, Publii G is coi^erned about children once they 
leav^' the Title^I program* For this public, '^^e. speci,fic message is based .bn 
a sustjained effects studj;*^and might be stat^ "most" children are continuing -'to 
show progress .even without extra help." In Xt^er words we have, geared each 
message towdrJ the specific characteristic^and ipf ormat;ion needs of the 
various publics even though the basic mes^ge might be the same. 

The implication for evaluation plar^^g should be obvious. The evaluator 
who plans to communicate evaluation r^^ults effectively . to several publics 
will need to identify many sources of|^,x^f ottaation. These information sou-'^ces 
must then be woven together into a cdn^rent overall evaluation design. Some 
information sou-rces may only be appropriate to one or two publics. To the 
extent that those publics can have an impact on the program being evaluated, 
the cori^esponding infgrmatioir sources become ^high ptiority sources. 

ERIC .■ ■ 



Source , Just as it is necessary to gear specif ic"^ messages to the 
information needs and ^characteristics of different publics, Vit is necessary to 
have that message presented by a credible * source. By source we mean atv 
individual whpm the public trusts. Again, note that we are defining public 
here in very specific terms; for example, greats of" children in a. part icular 
neighborhood, \ion-Title I teachers in a particular school, etc. 

Generally^ speaking, the naore the specific public -and the source have in • 
common, the more credible the source. will be. School public- relations experts 
speak^of key communicators with thid id?a in mind. Key communicators are 
people who are usually fairly easily identified in any, group. Basic 
sociometric techniquef, whether forjnally or informally a|)plied, may be, used to 
discover' who the "stars" of any group are'. These individuals are likely to be 
the ones fr9m whom other individuals in the group get their information. 

Returning to "the 67% of adults who have no children in the public schools. 

; . . . ■ ■ ' ■■ ^ 

we can discover many specific publics within this group; ^Jfjiii^ group consists 
o^^xvxz and religious groups, neighborhood groups, social ^groups, recreation 
groups, work grpups, and many other, subgroups or publi'cs. Within 'each of the 
subgroups or publics there are one or more stars or key communicators who can 
easily be identified. A major step in communication then is to cultivate 
thjsse specific individuals as sources. 

This process is most appropriate at the school level but may also be 
applied at the district level as ^elJ.. Many school principal^ and some 
district-level administrators keep li^ts of key communicators along with the 
phone numbers .of those key communicators handy. Ii?henever aom^thing impoittant 
happens or is about to happen, the school principals or other administrators 

> ' ^ . ' ■ • ' ' ' ■ \ 

inform key communicators who then spread the word throughout the rest <0f th6,. 

\ 

group. These same principals and adminiistrators also call periodic meetings 



juat to keep .key communicators up-to-date. This raises an important , issue, 
'Schooi principals are absolutely'^essential links in any communication proc^ess'* 
about any sch^l program whether i:: be with .internal publics or witji external 
publics. A good deal of attenrlor. -should be given t^>^ school principals in the 
^analysis phase to determine wh^t 1,..::= people know about the specif ic^ programs 
^f interest what their, attitudes .toward them are, and what /:heir impact on the 
programs is likeJLy to be. 

Channel . Having identified s ral different publics, their information 
needs, and appropriate 'sources for presenting informatiori to those publics, we 
turn our attention to deciding which Channels of communication are most ' 
appropriate. The results of the analysis step of the process may yield some 
helpful information in deciding upon one or more channels of information. For 
example, the result9 of the analysis may show that certain individuals or 

» ' " ' * 

publics normally get th^ir information in certain ways and prefer getting 
their ijiformation in those ways'. A concer^us among communication experts 

seems to be that- the .ma^ media (newspaper, television, radio) are appropriate 

< ' . . . ' , , / . . ^ : 

for disseminating large amounts ^f information to many people over a ^hort 

period of time. Howeverj these channels are not appropriate for shaping 

publip* opinion. Our opinions ^re typically shaped through interpersonal 

• * ♦ 

communication channels. . • 

, If the objective of communication is simply to disseminate basi*c ^ *. 

inf ormat;ion to a' wide audience with no intent to sliape or mold opinion or 
behavior, mas^ media are appropriate. On the other hand, if the analysis 
reveals there are negative atti't^xdes or misconceptions or hostility toward the 
progra^k then the .correction of these negative attitudes and hostilities will 
reqi/ire interpersonal approaches. One example of negative attitudes might be 
resentment against Title- I harbored by non-Title ^teaching staff. No amount 
of brochures, rjewslette^rs, posters, or other devices is likely t(> have any 



effect on this resentment • What will be required isl that one Title I person 
discuss Rationally with one non-Title I person what isl actually going on "in 



the pi^ogyam and how the prograp affects and interacts wifct^ the total school 

program. This one hon-Tit^e I person may then be cpnsider^ci a key 

communicator who can in turr. relay the message to other non-Title I teaching 

: ' Ik ' ^ 

staff. This is why an analysis of internal publics is so import-ant, and itr is 
why\identif ication of key communicators iS also ^ irapwt ant • 

As a final note, one can never be absolutely sure which channel will be 
the most effective in getting a message across to a specific public. 
Therefore, whenever the chance presents itself, it is helpful to present the 
same or similar messages to a given public through as many channels as 
possible. For example, in an AERA paper presentation, there are at least two 
channels of commjunication; the written word and the spoken word. The written 
or spoken word is often supp^lement^d with gf^phs, tables, or other kinds of 
illustrations. Some may respond mcyre positively to a question and answer 
Session. It is quite conceivable that four^ or five different channels might 
be^iis^^ itr ^ LSrEi^"^^ AERA paper presentation. Within those five channels, / 
there is ^likely to be something'^f or nearly '^every member of the audience. The 
same is true for other audiences or publics. « 

Reaction and Feedback . As we are deciding who needs to know wjiat and who 
should present this information through- whi^h channels, we also need to give 
some thought to the method by which we will find out whether or not the . 
communication was effective* In this regard w^ must focus on two concepts. 
As information is presentedr>to people, they have varying reactions* Some 
examples of reactions are letters to the editors of newspapers, calls to a 
school boarfd about a particularity volatile issue, and people tellitig y9u after 
an AERA presentation that you did a good job. These are all reactions. Tl)je 



single problem with all these reactions is that they tend to yield a biased , or ' 
distorted picture' of how the entire public received the message. Therefore, 
it is ^fiecessary to plan for the active solicitation of different kinds of 
.reactions from a representative sample of the specific public. This active 

J solicitation of reactions is termed feedback. , 

The strategies for getting feedl^fck are very similar to some of the 
strategies employed in the analysis step of the process. Therefore, the plan 

• may iftclude a formal sampling of specific publics, or it may simply consist ot 
follow-up conversations with several key 'communicators. Whatever the plan is,, 
it is important for the, evaluator or others involved in the planning to 
remember that the feedback must be represent^ive. In order for the feedback 
to be representative ,it must be^ctively. solicited.. Reliance on unsolicited 
reaction has kept more than one good "evalua^tor working ijj( f:he dark. 

, Conuaunicate " . ^ 

Having been through the first twp steps of the process^ we come to the 
step where infoTroation is actually shared wiltli someorie^^«e . This^st^p' ^trould 
be a lot easier if the first two steps have been carefully taken. In a sense, 
this step may be considered , similar to the tip of an iceberg* It is the part 
that i« seen but is actually smallest component. 

With the exception of editors of scientific journals and perhaps some of 
our colleagues, the basic format for all communications of evaluation results 
should be fairly similar* This format is graphically 'depicted below in 
Figure 2. - Figure 2 shows the s^ix basic questions addressed by journalists ^ 
^ followed by credible quotes from c^redible sources, followed by the details. 
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SPECIFIC 



y MANY 




^ Figure 2. Basic communication format 

The format depicted^ in Figure 2 is not just for newspaper articles but for 
brochures, newsletters, oral pre^eiitatiotra, atid even foriial evaltiation 
reports. As early as ppssi'bl^ in ^ presentation of results, ♦ the ev'aluatot 
needs to i-dentify who did something, what they did, Vhen and where they did 
it, why they did it, 'and how they did it. Particularly important with 



information intended for mass consumption, we need to tell the public thsT we 
are talkir4 about childretl... 1% we are not talking about children, we really 
^ do not have much to say (even to the two-thirds of adults who do not have 
children £n the public schools).^ 

One point to note is that the first pa^t of the prei3entation is quite 
broad but not very deept That is, a great deal of grpund is covered with 
little or no detail. Th^s is precisely the kind of information" that* is called 
fox here; tl^t is, a broad overview that does not go into too much detail. 
Details can be laved for later when yoti have the attention of the intended 
public. 
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Having gotten the attention qJ^ the specif ic ipublic, it is helpful to move 
)n to more specific iniormatiou* The next section of the triangle depicted 



Figure 2 is entitled Quotes and Sources. The- sources are those individuals 
« referred to earlier as credible sources to^specific publics. Any good 
h^spaper article, for example,, will quote people who are intii^tely familiar 
witTi the* facts of the story or Who 'are directly Evolved in the incident being 
reported.. Again, recallidg an earlier comment, "it will be helpful to match • 
sources to publics. Thus^ for" example, presentations to parent groups might 
well include oral or writte^ comments from other parents. Presentations to ^ 
school boards, on the other hand, might include observations from teachers, 
members, of the communi^ty^ or other groups of wfiom the board members deperfd for 
their political ba^e. Again, there is an obvious implication for evaluation 
practice. These comments constitute legitimate evaluation data for som6 
publics and must * therefore be collected. _ , ' 

The bottom portion of the triangle depicted in Figure 2 contains the • 
details. This is the proper place for tables, numerical and statistical 
analyses, and other supporting details. Except for mandated statistical" 
reports, these details sh'^uld be kept to an absolute minimum. This is also 
not the time or place/s^to summarize. The summary should have been at the very 
beginning.^ 

Assuming t;hat we ,are talking about^ a written report, you will have many 

readers at the beginning and fewer readers at 'the end. A simple way to 

illustrate this concept is to consider how you re;ad a newspaper. You probably 

read the headlines and perhaps the first paragraph or two of most artii^les on 

. * - / 

page one. If a story .begins on page one and is continued on page 36, it is 
not liKely that you will finish the story on page 36. ' 



. . . % 

/ Unless the story or article is about an issue that greatly concerns you or 
has a direct impact on your life, you will not read beyond the first 
paragraph.^ If you are mildly interested in the topic, you will read a bit 
more to see who' is involved and what their connients are. Only if you are 

• 

e;ctremely interested in or excited about the topic will you read all the way 
to^J^e, end of « the article on page 36. The same 4.s true for oral reports and* 
written reports. * If the purpose of the oral report is not clear by the end of 
the first few seconds, then vety few people will have , the intrinsic motivation 

' ' r - • 

to follow your *line ef thought until the end of the'- presentatix)n« 

In thi-s respect, -evaluators can ^ot ^fford to take a scholarly point* of 
view in reporting. That is^ we do not have the lujcury of providing an 
extensive discussion of background and methodology prior to the presentation 
of results and our .conclusions. Conclusions must usually b^presented firs.t 
followed by background. In this senses the fonkat for communicating or/ 
presenting the information mayN^e exactly the opposite of what many of us have 
been taught in graduate school as proper writing techniques. * v 

In summary then, the focus of any communication should be vefry broad at 
the outset and becom't more and more specific. "Fhis is true whether- the 
purpose of the communication is to provide basic information, or to persuade, 
or to clarify misconceptions, or to achieve any o^ther purpose. 

- ■ . I J/ - ■ . 

Evaluate » - ' . 

Having presented.'a well defined message! to a specific well-Identified 
public,* there is a tremendous temptation to believe that the job of 
communication is finished. However, it is not. The final task in any* ♦ 
communication is to evaluate the effectiveness of that communication. A major 
reason for conducting this evaluation is the fact that ^here are likely Co be 
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future opportunities or needs to communicater with the same public. Unless the 
evaluator or otbcr individual presenting the information has a thorough 
understanding of th , fectiveness of the communication, that person cannot 
plan effectively for t&ture communications, ^dme questions that need to be 
considered in this evaluation are .Did the public receive the message? Was 
the purpose of tKe communication ^^hieyed?" Stated somewhat differently, 
"Were the objectives met? Was any action taken? Did we reach them inybime?-" 
' A' crucial aspect of evaluation is being, able to deal with several. 



different possible answers to the questions 



presented above. There is an old 



axiom that if you can't deal witfi the answer, don't ask the question. In 

^ 'r ' - - 

.otjier words, evaluators and. program administrators should be prepared to 
listen carefully to criticism? and be ready to make changes where changes are 
clearly* indicated. If a report is presented to a parent group, for example, 
evaluators can talk to key communicators or a random sample o£ the people xn 
the groupi to ask what jdiey tljiought of the report. Did it seem accurate? Has 

**it changed any of their * attitudes^ What did it ^ean in'tein^ of the*ir * - » 
children or school? 

In evaluating the effectiveness of any communication, it is important for , 
the evaluator to keep several points in mind. First, people have selective 
mempries. What this means in communication is that those portions cif the 
communi^cation which support individuals' existing points of view are more' 
likely to be remembered and understood than those portions of the 
communication which do not, ^ In extreme cases, information receivers m^y 
actually remember exactly'the opposite of what the source said and yet believe- 
that it is exactly what ^ the source said. Second, where the subject is 
controversial, those individuals who have ^ken sides *are very unlikely to 
attend to new information. Of cotir^e, ^^i^Teyaluator will be veil aware of the 
exis'ting beliefs ajid views of the publics with*" whom he or she is communicating . 
■ ■ . - ■ ■> • -17- 



from the results of the analysis conducted in the first step< In the, planning 
step the evaluator or other communicator will have established communication 
objectives accordingly^ Given reasonable and manageable communication' 
objectives, the evaluation is more likely to produce results that will be 
effective in the next round of communication. 

T ■ ^ ■ 

Summary * . . . • 

In communicating with the public on the success of any school program, it 
is first necessary to detemine what the public already knows, what * 
misconceptions people may have, where people get their information^ and , who 
are likely to be the top priority publics. ,Given^this information, it is 
possible to develop thorough plans for communication. These plans consist of 
a series of decisions concerning who needs to know what, who should present 
the inf opnnation thrdugh what "channel," and how the i^sponse to the ^ 
communication will be monitored. Next, the plan iB implemented such that the 
big pict'ure is given firsthand the details last. Finally, feedback from the. 
public is actively solicited in an effort to determine whether or not ^ 
effective communication is taking place. This feedback is then used in the / 

ynext. cycle of planning. In, this way, the process becomes not a linear one of 

< L i - ■ • ^ 

four steps but a' cyclical step where each step leads i:0 another. 

• • ' . . ' ■ ' ' . -'^^ 

? At several points in th^ process, we have act.ively sought input from other 

people. Thus, communication must be viewed as a two-vay process. In essence, 

we listen as wbll as speak. Generally speaking, communication of evaluation 

results to the public is more effective if we are generally listening rather 

than generally speaking. 
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